In recent years, neural networks have attracted much attention in the machine learning and the deep learning technologies. Bio-inspired functions and intelligence are also expected to process efficiently and improve existing technologies. In the visual pathway, the prominent features consist of nonlinear characteristics of squaring and rectification functions observed in the retinal and visual cortex networks, respectively. Further, adaptation is an important feature to activate the biological systems, efficiently. Recently, to overcome short-comings of the deep learning techniques, orthogonality for the (...) weights in the networks has been developed for the signal propagation and the efficient optimization of the learning. In this paper, bio-inspired asymmetric networks with nonlinear characteristics are proposed, which are derived from the retinal networks in the biological visual pathway. The asymmetric network proposed here was verified to detect the movement of the object, efficiently in our previous studies. This paper shows a new characteristic of the adaptive orthogonality in the asymmetric networks. First, it is shown that the asymmetric network with nonlinear characteristics is effective for generating orthogonality. Second, the proposed asymmetric network with Gabor filters is compared with the conventional energy model from the point of the orthogonality characteristics. Finally, the asymmetric networks with nonlinear characteristics can generate the extended orthogonal bases in independent subspaces, which are useful for classification and efficient learning. (shrink)

Machine learning, deep learning and neural networks are extensively applied for the development of many fields. Though their technologies are improved greatly, they are often said to be opaque in terms of explainability. Their explainable neural functions will be essential to realization in the networks. In this paper, it is shown that the bio-inspired networks are useful for the explanation of tracking and classification of features. First, the asymmetric network with nonlinear functions is created based on the bio-inspired retinal network. (...) They have orthogonal properties useful for the tracking of features compared with the conventional symmetric networks, which is also proposed on the biological functions. Next, the analysis for the independence of the subspaces between the Fourier bases and the asymmetric network bases is performed. It was that the asymmetric networks have better performances in the classification compared with the symmetric ones. Further, the layered asymmetric networks generate the higher dimensional orthogonal bases that improve the classification accuracies by the replacements of bases. Finally, we classified Reuters collections data applying the explainable processing steps, which consist of the linear discriminations and the sparse coding with nearest neighbor relation for classification. (shrink)